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Abstract 

We establish a correspondence between two very general paradigms 
for systems that persist away from thermal equilibrium. In the first 
paradigm, a nonequilibrium steady state (NESS) is maintained by ap¬ 
plying fixed thermodynamic forces that break detailed balance. In the 
second paradigm, known as a stochastic pump (SP), a time-periodic state 
is maintained by the periodic variation of a system’s external parameters. 
In both cases, currents are generated and entropy is produced. Restricting 
ourselves to discrete-state systems, we establish a mapping between these 
scenarios. Given a NESS characterized by a particular set of stationary 
probabilities, currents and entropy production rates, we show how to con¬ 
struct a SP with exactly the same (time-averaged) values. The mapping 
works in the opposite direction as well. These results establish an equiv¬ 
alence between the two paradigms, by showing that stochastic pumps are 
able to mimic the behavior of nonequilibrium steady states, and vice-versa. 


1 Introduction and Motivation 

While there is currently no single theory that unifies all nonequilibrium phenom¬ 
ena, a number of useful paradigms of nonequilibrium behavior have emerged. 
These include: small perturbations near equilibrium; systems driven away from 
an initial state of equilibrium; spontaneous relaxation towards equilibrium; 
non-equilibrium steady states generated by fixed thermodynamic forces; and 
stochastic pumps driven by the time-periodic variation of external parameters. 
Theoretical frameworks developed within each paradigm - for instance, linear 
response theory to describe near-equilibrium perturbations - have contributed 
to a broader understanding of nonequilibrium processes. 

In this work we focus on two of these paradigms: non-equilibrium steady 
states and stochastic pumps. These share certain features, notably the persis¬ 
tence of non-vanishing currents and entropy production, which invite a compar¬ 
ison between the two. As elaborated below, we will devise a mapping from one 
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paradigm to the other: given a system in a nonequilibrium steady-state char¬ 
acterized by certain occupation probabilities, currents and entropy production 
rates, we will show how to construct a stochastic pump that exhibits the same 
(time-averaged) properties. The inverse direction, namely the construction of a 
nonequilibrium steady state with the same properties as a given, time-averaged 
stochastic pump, will also be discussed. 

In the nonequilibrium steady-state (NESS) paradigm, a system driven by 
fixed thermodynamic forces - such as temperature gradients or chemical po¬ 
tential differences - reaches a steady state in which its statistical properties are 
stationary with time. Unlike an equilibrium state, a nonequilibrium steady state 
exhibits non-vanishing currents, reflecting the violation of detailed balance. In 
order to maintain such a state, a thermodynamic cost must be paid. This cost 
is measured by the continual depletion of a thermodynamic resource, such as 
a chemical fuel, resulting in the production of entropy in the system’s thermal 
surroundings. 

Biomolecular motors illustrate the NESS paradigm [Till]: a reaction such 
as ATP hydrolysis [ATP —>■ ADP + Pi) produces entropy in the surrounding 
solution, and the chemical potential difference between reactants and products 
provides the thermodynamic force. The “current” in this situation corresponds 
to the mechanical motion produced by the motor, for instance the systematic 
displacement of kinesin motor toward the positive end of a microtubule filament. 
For a recent review of the stochastic theory of nonequilibrium steady states, as 
applied to biochemical processes, see Ref. [S]. 

In the stochastic pump paradigm, a system is driven by the time-periodic 
variation of external parameters in the presence of a thermal reservoir. Typi¬ 
cally, it is assumed that the dynamics satisfy detailed balance at every instant 
in time - in other words, if the parameters were suddenly frozen at their instan¬ 
taneous values, the system would relax to an equilibrium state. Under suitable 
conditions, a periodically driven system reaches a time-periodic state with non¬ 
vanishing time-averaged currents. These currents are effectively “pumped” by 
the periodic variation of the parameters, and the cost associated with pumping 
these currents is the work invested in driving the parameters. Ultimately, the 
energy provided by this work is dissipated into the thermal reservoir, resulting 
in the production of entropy. 

The study of stochastic pumps has been stimulated by experiments on ar¬ 
tificial molecular machines [Si, which are manipulated by the variation of 
external parameters to achieve some desired behavior. For instance, in experi¬ 
ments on catenanes - mechanically interlocked ring-like molecules - the aim was 
to produce unidirectional rotation of one ring around the other |^. Theoretical 
investigations of SP have focused on slowly driven mm as well as weakly driven 
[18] pumps, “no-pumping” theorems [T2l|T4lH](TOlHI] , the role of interactions 
[1] and fluctuations [15j . and the ability to extract work from stochastic pumps 

m- 

Underlying both the experimental work on artificial molecular machines and 
the theoretical work on stochastic pumps is the broad goal of understanding 
how to achieve controlled motion at the molecular level, where thermal fluc¬ 
tuations are large. The focus on time-dependent driving is motivated in part 
by the difficulty of synthesizing artificial molecular systems that, like biologi¬ 
cal molecular motors, takes advantage of chemical potential differences to drive 
steady currents. It is often simpler to manipulate the system by varying external 
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parameters such as temperature and the surrounding chemical environment. 

In both nonequilbrium steady states and stochastic pumps, the generated 
currents can be viewed as desired outcomes, and entropy production as the cost 
of achieving them. In this perspective, fixed thermodynamic forces (NESS) and 
time-periodic external driving (SP) represent the tools at our disposal. It is 
then interesting to compare these two sets of tools with respect to the degree of 
control that can be achieved. In particular, in this paper we investigate whether 
time-periodic driving can always achieve the same time-averaged outcome (i.e. 
identical currents) as fixed thermodynamic forces, and at the same cost (identi¬ 
cal time-averaged entropy production). In other words, can a stochastic pump 
“mimic” an arbitrary nonequilibrium steady state? 

More precisely, we begin by considering a generic Markov process of random 
transitions among n states of a system. The transition rates are fixed in time 
and do not satisfy detailed balance, hence the dynamics lead to a NESS with 
nonvanishing currents and entropy production. We then show how to prescribe 
a stochastic pump that has, in the limit of many cycles, the same time aver¬ 
aged probabilities, currents and entropy production rates as the NESS. This 
prescription is constructive though not unique. Surprisingly, the construction 
does not require the solution of any differential equations, only linear, algebraic 
equations. By contrast, a mapping in the opposite direction (from SP to NESS) 
requires that we first determine the periodic state of the system, which involves 
solving a set of coupled ordinary differential equations with time-periodic pa¬ 
rameters. Typically this can only be done numerically. 

The rest of the manuscript is organized as follows: In sectionj^we formulate 
the problem and review some useful known results. We then consider in section 
the simpler direction, namely mapping a stochastic pump into a NESS. In 
section we present two types of transformations for detailed balance matrices 
which play a key role in our construction of a SP that mimics NESS, and the “no 
current-loops” property that sets a constraint on pumping with time-dependent 
detailed balance matrix. The construction of a pumping protocol is described 
in section We finish with few concluding remarks in section 


2 Setup and Background 

2.1 Definitions 

We limit ourselves to an ergodic, continuous-time Markovian system with n 
states. The evolution of the system consists of random, Poissonian transitions 
among these states, with transition rates that are governed either by a time- 
independent rate matrix TZ (when analyzing nonequilibrium steady states) or 
a time-periodic rate matrix W(t) (for stochastic pumps), as described in more 
detail below. It is convenient to picture the system in terms of a “connectiv¬ 
ity graph” with n nodes and a finite number of edges connecting given pairs 
of nodes. An edge between states i and j implies that the system can make 
transitions between these states (see Fig. [^. We will use p{t) to denote the 
vector of the probabilities whose i’th component Pi{t) is the probability for the 
system to be in state i at time t. 

In the NESS scenario, the evolution of the system obeys the master equation 

dtp = Up. (1) 
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Figure 1: A four-state system described by a graph. Each node represents a 
state of the system. The edges represent non-vanishing transition rates between 
states. In this example, direct transitions between states 1 and 3 are not allowed. 


For i 7 ^ j, the matrix element 72.^- is the probability per unit time for a system 
in state j to make a transition to state i. The diagonal elements of 72 are 
negative, and are determined by conservation of probability: '^ij = 0 - For 

the system to be ergodic, we demand that (i) if TZij ^ 0 then also 72.^^ 7 ^ 0 , and 
(ii) the graph associated with 72 is connected. That is, for any pair of nodes 
(states) i and j, there exists a path from i to j, possibly through a sequence 
of intermediate nodes, along the edges of the graph. Under these conditions, 
Eq. Q has a unique steady state solution, which we will denote by p , and any 
solution of Eq. Q converges to this steady state in the long-time limit CD- 
In addition to the steady state probabilities p®®, we will be interested in the 
steady state currents, defined by 


Jff = 7^.,pf - 7^ppf 


and the entropy production rates associated with these currents [T^ : 


( 2 ) 




72.pp®® 


(3) 


We will assume that some of these currents, and therefore the corresponding 
entropy production rates, are non-vanishing. In other words we assume the dy¬ 
namics violate detailed balance, hence p ®® is a genuinely nonequilibrium steady 
state. 

In the stochastic pump scenario, the system obeys a master equation with a 
time-periodic rate matrix. 


dtp = yV{t)p, (4) 

where 

W{t) =Wit + T) (5) 

for some finite period T. If we momentarily treat t in Eq. @ as a parameter 
of the rate matrix (rather than as the time variable), then for any fixed value 
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of this parameter we will assume the rate matrix W{t) has a unique stationary 
solution Tr{t), and we further assume that 

WijTTj - WjiTTi = 0 ( 6 ) 

In other words, the dynamics generated by W(t) (for fixed t) satisfy detailed 
balance. We will refer to 7f{t) as the equilibrium state of Wit). This is the state 
to which the system would relax if all the transition rates were “frozen” in 
time. 

Let us now return to thinking of t as time. For any solution of Eq.Q the 
quantities 


Jy(t) = WijPj -WjiPi 

(7) 


(8) 


(suppressing the argument t on the right side) represent instantaneous currents 
and entropy production rates. Under Eqs.( |4|5[ ) the statistical state of the system 
evolves asymptotically to a unique time periodic state, 

jF^it)=jF^it + T), (9) 


with currents and entropy production rates 




(10) 

<*(0 

= log 

(11) 


These are analogous to the quantities appearing in Eqs.(2 3), only J^fit) and 
<jfJ{t) are periodic with time, whereas and cr®® do not vary with time. 

Throughout this paper we will be interested in the asymptotic properties of 
the system, therefore we will consider only the steady state p ®® and the periodic 
state p^®(t), and not the process of relaxation to either of these states. 

In order to compare the NESS and stochastic pump (SP) scenarios, let us 
define the time averaged quantities in the periodic state of the SP: 




ps 

= 




erf/ {t)dt. 

^ Jo 


( 12 ) 


The problem that we wish to study can now be formulated as follows. 


Problem Formulation: Given a time-independent rate matrix TZ correspond¬ 
ing to steady state quantities p®®, JT”®® and ct®®, we want to construct a time 
periodic detailed balance rate matrix >V(t) whose periodic state is described by 
the same quantities, after averaging over time: 




= P^ 


rrps rrss 

ij ij 




(13) 


We denote the above problem as the “forward” problem. We will also be inter¬ 
ested in the “inverse” problem: given a time-dependent detailed balance rate 
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matrix W(t) corresponding to the time-averaged quantities pf*, and crfj, we 

want to construct a time-independent rate matrix TZ such that Eq.(13) holds. 
As we discuss in more detail below, the solution of the inverse problem fol¬ 
lows directly from known results, therefore we will focus mainly on the forward 
problem in this paper. 

When TZ and W(t) give rise to dynamics that satisfy Eq.( 13), we will say that 
the stochastic pump “mimics” the nonequilibrium steady state, and vice-versa. 


2.2 Two Useful Decompositions 

The two well known decompositions described below, the first - an algebraic 
decomposition of rate matrices, and the second - a topological decomposition 
of the connectivity graph, will be extensively used in what follows. 


2.2.1 Rate matrix decomposition 

The following (unique) decomposition of any rate matrix TZ, obtained by Zia 
and Schmittmann m, will prove to be useful: 


TZ={S+-J^ 


(14) 


Here the multiplication is ordinary matrix multiplication, and 5 is a symmetric 
matrix whose elements in each column add up to zero, with negative entries only 
on the diagonal. J''*® is the anti-symmetric current matrix defined in Eq.([^ and 
'P = diag(p®'*) is the diagonal matrix with elements 'Pu = pf^. 

An immediate corollary of Eq. (141 is the following statement: if a rate 


matrix TZ is the product of a symmetric rate matrix S and a diagonal matrix 
T’ (with positive diagonal entries summing to unity), then TZ satisfies detailed 
balance, i.e. there are no currents in the stationary state. 


2.2.2 Cycle Decomposition 

The currents that characterize a NESS are in general not independent of one 
another, as they must satisfy constraints arising from the conservation of prob¬ 
ability. These constraints embody Kirchoff’s law of currents. The cycle decom¬ 
position method provides a convenient tool to account for these constraints [16j . 
Briefly, in a connected network with N nodes and E edges, the conservation of 
probability imposes N — 1 constraints among the E currents (one current per 
edge). It is then convenient to identify C = E — N-\-l fundamental currents, us¬ 
ing the following procedure. First, we build a connectivity graph for the system, 
as described above and illustrated in Fig.([^ for the case of four nodes and six 
edges (hence C = 3). We then construct a maximal spanning tree, by removing 
C edges without breaking the connectivity of the graph; this tree, illustrated by 
the red dash-dotted lines in Fig.([^, has no cycles. In the context of the original 
graph, the C edges that are removed to form the spanning tree are called fun¬ 
damental edges. The currents along these edges are the fundamental currents 
(the black arrows in the figure), and the currents along the edges of the tree are 
the spanning tree currents (the red arrows in the figure). 

For NESS, the steady state currents along the C fundamental edges can take 
on any values, independently of one another. However, once these fundamental 
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currents are set, the spanning tree currents are then uniquely determined by 
conservation of probability: the total sum of incoming and outgoing currents at 
each state must vanishes in the steady state. Therefore, the number of degrees 
of freedom in the matrix is not (r? — n) jl as for an arbitrary anti-symmetric 
matrix, but is determined by the graph topology. 

Unlike NESS, for stochastic pumps the fundamental currents at each mo¬ 
ment do not fix the currents on the spanning tree edges since probabilities can 
temporarily accumulate on the vertices (Kirchoff’s current law does not apply 
at any instant of time). However, J'p® on the fundamental edges do dictate J'p® 
on the spanning tree, since the average probabilities are conserved. 


3 Mapping SP to NESS 


In this section we consider the inverse problem defined at the end of Sec. |2.1[ 
which conceptually is the simpler direction: given a time-dependent periodic 
rate matrix W(t), how do we construct a time-independent rate matrix TZ whose 
steady state properties satisfy Eq.(13)? 

To construct TZ, we first solve for the periodic averages and 

associated with W{t). These can be calculated by obtaining the periodic solution 
of the master equation, and then plugging this solution into Eq.(12). In 

most cases, however, finding the periodic solution must be done numerically. 

Once pf® 

TZ whose steady state properties, p 


Jf^ and erf/ are known, we next have to build a rate matrix 

‘'J ' 


J'®® and fj®®, satisfy Eq.(I3). A nice 


consequence of Eq. (14) is that if all the currents along the graph edges are non¬ 
zero, then the quantities p®®, i/®® and ct®® uniquely determine TZ. We express 
this relationship by the shorthand notation 


{p^\J^\cr^^}^TZ 


(15) 


To see this, we use Eq.(14) to write the entropy production rates as 




J_ 1 7 " 
"T 0*^7 




<? • - _ A 7"^ 


(16) 


By this equation, the elements of 
currents are non-zero: 


and cr®® uniquely determine S, if the 


®}=^5 


(17) 


If some of the currents are zero, then the corresponding elements of S are not 
uniquely determined from the currents and entropy production alone, and they 
can be arbitrarily chosen. Once S has been obtained consistently with ^7'®® and 
O'®®, it can be combined with 'P and >7®®, via Eq.(14), to give TZ. 


In the remainder of this paper, we will address the forward problem, namely 
how to construct, for a given NESS, a mimicking SP protocol. While this 
problem is conceptually more complicated than the inverse problem discussed 
above, it turns out that it is computationally much simpler and does not require 
any solution of differential equations. 
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P«=0.1 


P«=0.4 



Figure 2: A concrete example of a NESS for which we build an equivalent 
stochastic pump. In this example TZij ^ 0 for any i,j. The spanning tree was 
chosen to be the 2-1, 2-3 and 2-4 edges (dashed red lines), and the fundamental 
currents are the currents along the 1-4, 1-3 and 3-4 edges (solid black lines). In 
this system, there are two current-loops: 1 —>■ 3 —)■ 4 —>■ 1 and 2 —)■ 3 —>■ 4 —>■ 2. 


4 Key Ideas 

Here we establish three technical results that will play a crucial role in the 
construction of yV(t). 


4.1 No Current-Loops in Detail Balance Systems 


A system satisfying detailed balance has non-vanishing currents when the in¬ 
stantaneously probability distribution differs from the equilibrium state of the 
instantaneous rate matrix. These currents, however, cannot form a current loop. 
That is, no loop i, j, k, ■ ■ ■ m,i on the graph associated with the system can have 
all the currents oriented in the same direction around the loop. As an example 
of a current loop, consider the system described in Fig. ([^. No detailed bal¬ 
ance system can have instantaneous currents equal to the currents in the loop 
1 —>■ 3 —>■ 4 —>■ 1 (or in the loop 2 —3 —>■ 4 —2), since they all have the same 
orientation. 

To see why a current loop is inconsistent with detailed balance, let us con¬ 
sider the currents along the edges of a loop i, j, fc, ...m, i. Using Eq.(14) to 
decompose the detailed balance rate matrix W = 50“^, the currents generated 
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= 25!5 

J 21 

^ JS,=13.5 


First half cycle 



Second half cycle 


T 


Figure 3: The currents of the stochastic pump constructed to mimic the NESS 
in Fig.([^. The pumped currents during the first (left) and second (right) half¬ 
periods are shown. On each of the edges, the current directions in the two half 
periods are opposite. Note that there are no current-loops in both of the half 
periods. 


by a distribution q satisfy 


— 1 — 1 

J jk —1 —1 

^k-TTj qj, 


(18) 

(19) 


mi — 1 _ 1 

— = TT^ ft - T^m Qm- 


( 20 ) 


Summing these equations we get that 'Y^{J/S) = 0 around the loop. This 
means that not all the currents can have the same sign, since each Sij > 0. 
Therefore there are no current loops. (A similar argument was used in |12j'). 

By contrast, the steady state currents of a NESS must form at least one 
current-loop. To see this, just choose a site (denoted by i) through which some 
of the steady state currents flow. Conservation of probability implies that at 
least one of these currents is going out of the site *, so we choose such a current 
say from i into site j. Now from the site j again, there is at least one current 
going out, say to to site k. Following the same argument, from any site we can 
“flow” with a current into a new site, but since the number of sites is finite, 
after no more than n such steps we must come back to a site we already visited. 
Therefore, there must exist at least one current-loop. 


4.2 Transformation for the diagonal part of the decompo¬ 
sition of W 

Suppose we have a detailed balance rate matrix W and two instantaneous prob¬ 
ability distributions q and p, neither of which necessarily correspond to a sta¬ 
tionary distribution. We would like to transform VV into a different detailed 
balance rate matrix, W, such that Wq = Wp. This is achieved by the following 
transformation 


W = WQV-\ 


(21a) 
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where V and Q are the diagonal matrices corresponding to p and q, respectively. 
Using indices, this reads 


hVij — y^ijQjPj 


-1 


(21b) 


The transformation given by Eq.(21a) affects only the diagonal part of the 


decomposition and has the following properties: 

1. If yV satisfies the detailed balance condition, then so does W. This can be 
seen by using the decomposition of VV as in Eq.(14| in the above trans¬ 


formation and noting that W is a symmetric rate matrix times a diagonal 
matrix, and therefore it has no currents in its steady state. 

2. The instantaneous currents of a system described by VV with probabilities 
q are the same as those of a system described by W with the probabilities 
p. This follows by substituting Eq.(21b) into Eq. 0. 

3. From Eqs.( 21bl8 ) it follows that the instantaneous entropy production 
rates along each edge (aij) for a system described by VV with probabilities 
q and for a system described by W with probabilities p are the same. 


The significance of this transformation can be stated as follows. If we have 
a rate matrix VV and probabilities q, which produce instantaneous currents 
and entropy production rates a, then for any other probability distribution p 
we can construct the rate matrix W that generates the same and a. 


4.3 Transformation for the symmetric part of the decom¬ 
position of W 

Currents arise in a system described by a detailed balance W when the instan¬ 
taneous probability distribution p differs from the equilibrium distribution, tt. 
We next show how to vary the magnitudes of these currents (but not their di¬ 
rections) while keeping p and tt fixed. As the directions of the currents do not 
vary under this transformation, no loops can be formed in accordance with the 
“No loop condition” in Sec.(4.1). 

Let us use the decomposition W = 511“^ where S is symmetric and 11 = 
diag(7f). The currents are then given by 


^ij — 


(tT^ ^Pj - TT . 


( 22 ) 


We see that by varying Sij 
its sign, since Sij > 0. 


we vary the magnitude of the current jTi, , but not 


This transformation is complementary to the one given by Eq.(21): it en¬ 


ables us to change the currents (and entropy production rates) while keeping 
the probabilities p and tt fixed, by tuning the symmetric part of W in the de¬ 


composition given by Eq.(14). By contrast, with the previous transformation 


we can vary the probabilities p and tt at fixed currents and entropy production 
rates, by tuning the diagonal part of W. 


5 Construction of the pumping protocol 


Given a rate matrix TZ one can calculate its steady state p (the null eigenvector 
of TZ) and thus J'®* and using Eqs.(^). Our goal is to construct a periodic 
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pumping protocol - a time-dependent detailed balance rate matrix W(t) with 
some period T - such that Eqs.( 13) hold, or in other words a SP that mimics the 


NESS. For simplicity, we assume that there are no edges along which the steady 
state currents are zero. The case involving zero currents along some edges is 
analyzed in the appendix. 

We note that in general there are many SP’s that mimic any specific NESS 
- the mapping is not one-to-one. Out of the many SP that mimic the NESS, we 
wish to choose one using a relatively simple construction, yet generic enough to 
mimic any NESS. Naively we would like to have a SP whose periodic state gives 


rise to time-independent quantities, = pf 




and 


\t) = 


(t|J. Such a construction is, unfortunately, impossible. This can be seen from 
the result of Sec. (4.1), which states that for all t, cannot have any 

current loops, whereas must have at least one current loop. Thus, we can 
only hope to achieve a mapping between the time-averaged quantities associated 
with the SP and those of the NESS, as in Eq.(13). This also implies that at 


least some of the currents of the SP must be time-dependent. 

The construction described below, though the simplest we could find, is 
nevertheless somewhat convoluted. We therefore first give an overview before 
proceeding to the detailed description. The main reason for the complication 
is the fact that the periodic solution, is a highly non-trivial function of 

the pumping protocol W(t). To avoid this complication, we construct simulta¬ 
neously both the pumping protocol W(t) and its periodic solution pY{t). This 
is achieved in 5 steps. 

In the first step, described in Sec. (5.1), we divide the pumping protocol 


temporal interval of duration T into two equal half-intervals, designated as a 
and b. We then assign an arbitrary, fixed detailed balanced matrix and 
an arbitrary, fixed probability distribution to be associated with the first 
half-period of driving. We will refer to yV“ and (f* together as the seed for that 
half-cycle, and these quantities will be used to set the current directions during 
that time interval. Next, the seed and current directions for the first half-cycle 
are used to assign a seed (VV^, if) and current directions for the second half¬ 
cycle. The current directions during the first half-cycle are opposite of those of 
the second half-cycle, and both sets are, by construction, consistent with the 


“no current loop” condition in Sec. (4.1). 


In the next two steps, we use the seeds to construct fixed sets of currents 
and and entropy production rates (cr“ and a^j) for the first and second 
halves of the cycle, whose averages over the two halves are equal to the steady- 
state values that we wish to mimic: 


J ss _ ^ I 

ij — 2 Wij '-'ijj 


= 2 ('"b 


(23) 


for all i 7 ^ j. This is done first for the fundamental currents in Sec. (5.2) and 


then for the spanning tree currents in Sec. (5.3). 


Up to this point, the currents and entropy production rates for the two 
half-cycles have been constructed from the initial, arbitrary seeds, but the cor¬ 
responding time-periodic rate matrices and that actually generate 

these currents and entropies are not yet known. In the fourth step, described 
in Sec. (5.4), we use the transformation of Sec. ( |4.3| ) to adjust the symmetric 
part of the seed matrices, arriving at new rate matrices yV“’^ that pro¬ 

duce the desired currents for the seed probabilities These currents, 


11 










together with the desired averaged probabilities pf®, fix (0 • the last step 


(Sec. 5.51 we use the transformation of Sec. (4.2), together with the symmetric 
parts of to construct rate matrices W°‘{t) and yV^{t) for which is 

the periodic solution of the master equation. 

In the specific protocol described below, the entries of the matrix yV’(t) are 
not continuous functions of time, as they have discontinuities between the two 
T /2 intervals. These discontinuities are not essential, and can be removed at 
the expense of making the construction less transparent. 

To improve the clarity of presentation, some of the formal definitions of the 
construction are followed by a concrete application to the example of a 4-state 
system described in Fig. (i). In this example the NESS system has 4 states with 
p®® = (0.1, 0.2,0.3, 0.4). The fundamental currents were chosen such that they 
form a loop, and their values are = 3, Jl§ = 2 and JH = 1. The currents 
for the spanning tree edges are then dictated by Kirchoff’s law - the sum of 
currents in each vertex must be zero. The corresponding current-matrix is 


JSS ^ 


/ 0 2 

-3 

1 

\ 

-2 0 

1 

1 


3 -1 

0 

-2 


V-1 -1 

2 

0 

/ 


(24) 


Finally, we choose the entropy production rate to be 1 along all the edges. 


Using Eq.(16) the matrix S can be calculated, and is given in Eq.(42) in the 


Appendix. The matrix TZ giving rise to this particular NESS can be constructed 


using Eq.( 14). 


5.1 Step 1- choosing the seed 

In what follows, superscripts a and b stand for quantities associated with the 
first and second halves of the period, respectively. 

Our first step is to choose an arbitrary detailed balance matrix on the graph. 
This is done by choosing an equilibrium state for the first half period ??“ and 
a symmetric rate matrix S from which we compose W“ = 5(11“)“^ where 
n“ = diag(•?“). Next, we choose a fixed probability distribution if* ^ that 
satisfies 


log 


< 9 ? 


qf 


< 


log ^ 


(25) 


for any j. It is always possible to satisfy this condition, by choosing 9 “ close 
enough to 7?“. As we will see in the next section, this condition is necessary for 
the consistency of our construction. 

For the second half of the period we replace 7 ?“ and (f* by vectors with 
components = l/ 7 r“ - from which we construct = 5(11^)“^ - and q\ = 
l/gf. The two probability vectors tt^ and if are not normalized, but as will 
become clear, this normalization does not play any role, and it will prove to be 
simpler to work with these unnormalized vectors. We note that the currents 
generated by VV“ and f, 


_ <5 (a\ 

ij j ’ 


(26) 
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have, on each edge, opposite signs to those generated by W*’ and (f, given by 




(27) 


The values of 77^“’^ will not explicitly be used in what follows - only their direc¬ 
tions, which by construction are consistent with detail balance. We additionally 
note that 


log 




= - log 




(28) 


To illustrate this part of the construction with our four-state example, we 
choose 


5 = 


( 

1 

I 

1 ^ 


/ 1/4 \ 

I 

-3 

I 

1 

=*a 

1/4 

I 

1 

-3 

1 

1 ^ — 

1/4 

V 1 

1 

1 

-3 ^ 


^ 1/4 / 


(29) 


Both S and 7?“ are, in fact, arbitrary. 

We next note that min^ [log — log77.jipf^] = 1/3. If we therefore 

choose ^ such that |log7r“ — logg“| < 1/6,then Eq.(25) is satisfied. Any vector 


close enough to 7?“ will do. As an example we use = (0.23,0.24,0.26,0.27). 
In the second half of the period these correspond to tt^ = (4,4,4,4) and g* = 
(4.3478,4.1667,3.8462,3.7037). 


5.2 Step 2 - fundamental edge currents 

In this step we set the currents along the fundamental edges to be constant 
during each of the two half cycles, such that their time averages (the average 
between the first and second halves) is equal to 77®®, and the time average of 
the entropy production rates is equal to tr®®. Moreover, we will choose these 
fundamental currents to have the same directions as the fundamental currents in 
77“ during the first half-cycle, and to be reversed in direction during the second 
half-cycle. 

We first make sure that for each fundamental edge, the average of 77)“ and 
77ij, and therefore the time averaged current, is exactly 77^^®. To that effect we 
introduce the following rule: 

• If the direction of the NESS current, 77®/, is the same as the direction of 77“ 

defined above, then we set in the first half of the period 77)“- = (2 + Q:ij)77®® 
and in the second half of the period where are positive 

and will be determined below. 

• If the direction of the NESS current, 77®® i is not the same as the direction 
of then we set in the first half of the period 77“ = —oiijJif and in 
the second half 77^- = {2 + 

According to this rule, the directions of the currents during the first half of 
the period are the same as that of 77j and are opposite to those in the second 
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half. Moreover, by the above construction the time averaged currents on the 
fundamental edges have the required values: 


1 

2 



_ rrSS 

— Jij . 


(30) 


Next we determine the values of the aij ’s so as to satisfy the requirement on 
the entropy production rates. Assuming for the moment that the probability 
distributions in the first and second halves of the period are given by and (f 
and that the equilibrium distributions of the detailed balance matrices during 
the first and second halves of the period are given by 7?“ and 7?^ respectively, 
then the entropy production rates with the currents and during the two 
halves of the cycle are given by 


= J,“log 






TT^Q^ 

<^i3 = Jij - 




(31) 


Substituting in these equations and in terms of and demanding that 
I ) = ^1/; gives an equation for whose solution is 




-1 


log 


Qj 


log 




iPT 


T^ijPi 


- 1 . 


(32) 


Eq.(25l ensures that indeed > 0. 


To illustrate this step, we examine the signs of the currents generated by 
the matrix VV“ = 5(11“)“^ and the probability (f*, denoted by on the 
fundamental edges: 


sign 




= +1, sign 


(*-) 


= +1, sign 


(A) 


= +l. 


(33) 


While the direction of the current along the 1-4 edge is the same as the current 
orientation of for the other two fundamental edges the directions of J°‘ 
and J''*® are not the same. 

We next solve Eq.([3^ for aij. The explicit expression, as well as the currents, 
are given in the appendix. Fig(|^ shows the currents on the first half period (left) 
and second half period (right). Note that (i) the direction of the currents along 
each edge are opposite in the two halves of the period (ii) as discussed above, in 
the first half period the direction of the current along the 1-4 edge is the same as 
that of Fig([^, but the direction of currents along the other fundamental edges 
are different from that of Fig([^, and (iii) there are no current loops in Fig(|^. 


5.3 Step 3 - Spanning tree currents 

So far we have shown how to construct the fundamental edge currents. Next 
we discuss the currents along the edges of the spanning tree. For both the first 
and the second half-periods we impose the following two constraints: 
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1. The sum of currents feeding into any site i during the first half-period 
must be equal to minus the same quantity during the next half-period: 




(34) 


These constraints ensure that we indeed have a periodic time evolution: 
Api = Jq dtPidt = + Jij) = 0. Note that these are only 

n — 1 independent equations, since conservation of probability adds the 
constraint = 0 ■ 


2. For each spanning tree edge we demand that 








(35) 


The number of edges in the spanning tree is n — 1, and therefore these are 
n — 1 additional equations. They ensure that the time-averaged entropy 
production rate along the i,j edge are the same as crfj. 


All together Eqs. (34 35) are 2(n — 1) linear equations for 2{n — 1) unknowns: 


^7“’^ on the spanning tree, which has n—1 edges. Moreover, the directions 
that solve these equations are the same as that of respectively. To see this, 
let us use the definition of (f and tt*’ in the second condition above, together 
with the definition of cr|J (Eqj^: 


(J)“-4)=2J- log 




log 


T^ijPY 


(36) 


Taking the absolute value of both sides in the above equation and using Eq.( 25) 
implies that 


J a _ /ro -^9 'Tss 

^'tj\ ^ ^ \ ^U 


(37) 


However, by the construction of and their average is equal to the steady 
state current, , therefore 


(+ 4 ) /2 = 


(38) 


Eqs. (38 37) are consistent with each other only if the sign of is opposite 


to that of J”/ . Moreover, as cr®® > 0 (this follows from Eq.(16)), the signs 


of and J’j, must be the same as that of log7r“g“/(7“7r“ and log7r''(7*/g('7r^. 


respectively, otherwise the left hand side of Eq. (351 will be negative. Therefore 
it is also the same as the sign of 


5.4 Step 4 - Transforming the symmetric part for the cur¬ 
rents 

At this stage we have constructed the currents for both half cycles with the same 
directions as the currents of VV“’^ with We can now use the transformation 
of the symmetric part of the decomposition of the rate matrix (defined in section 
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4.3) to change the symmetric part of W such that the currents generated by the 
transformed matrix and the seed probabilities have the constructed values: 


ca 


Sf, = 


7 “ 




(39) 


Importantly, all these off-diagonal elements are positive. This follows from the 
fact that the denominators are just /Sij, but by our construction the signs 
of is the same as that of ■ The diagonal elements of 5“’^ are now 
determined by the requirement that the sum of each of the columns is zero. 


5.5 Step 5 - Forming a solution to the master equation 

We have now arrived at the matrices yV“’*’ = These are the 

transformed seed matrices, which have been constructed (by tuning the elements 
of 5“’*’) so as to produce the desired currents and entropy production rates when 
the probability vectors are . However, the time average of is not 
and in fact are not solutions of the master equation: ^ ypa,b^,b ^ 

To remedy this situation we use the tr ansfo rmation of the diagonal part of the 


4.2 


decomposition of W, defined in section 

First, we want the time-averaged probabilities to be equal to p®*. Second, 
we already know what dtPi should be, in terms of the desired currents 
Namely, dtPi = Jij- Therefore we do the following: 


1. Calculate = dtp = These are the temporal slopes of the 

probabilities that solve the master equation, during the first and second 
halves of the period. 

2. Choose T such that 0 < pf® ± (T< 1 for any i. This choice ensures 
that the probabilities stay bounded between 0 and 1, and is always possible 
by taking T to be small enough. 


3. 


Construct pf{t) = pf® — (T/4)m“-|-m“t and p\{t) = p®® — {ZT/ 

These are the solutions of the master equation in the first and second 
halves of the period, respectively. It follows from Eq.(34| that m\ = —mf. 
This further implies that the probabilities defined above are continuous 
functions of time, i.e. p“(T/2) = p\{T/2) and p“(0) = p\{T), as they 
should be. 


4. From the above we define: 


W(t) 


5“(n“)-iQ“(iP“)-i(t) 

5b(n&)-igb(7?b)-i(i) 


t < r/2 

t>Tl2' 


(40) 


The matrix yV’(t) has all the periodic state averages we demand, and its periodic 
state solutions in the two halves of the period are, by construction, p“’^(t). 

For our example, we calculate the slopes dtp on the two half cycles by 
proper summation of the currents: dt'^ = (37.89,-2.51,5.85,-41.22) and 
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0.6 




Figure 4: p(t) of the proposed construction for our four-state example. The blue 
line is the exact (constructed) solution, and the red dots represent the numerical 
solution of the master equation. 

dtffi = (-37.89,2.51,-5.85,41.22), which as expected are equal in magnitude 
and opposite in sign. To satisfy 0 < Pi(t) < 1, we must choose T small enough, 
say T = 0.01. Using T we can obtain the time-dependent probability distribu¬ 
tions These linear functions are plotted in Fig.Q. Plugging these into 

Eq.([40| gives W{t). To verify that the solution of the master equation with 
the constructed W(t) has the required properties we solve this system numeri¬ 
cally. The numerical results for p(t), shown as red circles in FigQ, agree (up 
to numerical error) with the analytical solution. 


6 Conclusions 

We conclude with a few comments on our construction. First, the protocol 
presented above is clearly not unique. For example, different seeds or choices 
of a spanning tree result in different protocols. The non-uniqueness might be 
used, in principle, to match additional quantities, e.g. fluctuations around the 
average or the rate of decay towards the steady and periodic states. In addition, 
as mentioned previously, in our construction Wit) has discontinuities between 
the two halves of the period. This results from discontinuities in 5, 11 and 
Q. The discontinuities in S can be avoided if the currents are not taken to be 
fixed during the two halves of the period, but changing with time, such that the 
currents at t = T/2 vanish. The discontinuities in 11 and Q can be avoided if we 
change g as a function of time, crossing if at t = T/2. This, however, makes the 
construction more cumbersome. Next, we note that in the above construction 
both the symmetric and the diagonal parts of the decomposition of W change 
with time. This is known to be an essential feature of all pumping protocols 

M- 
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Lastly, we note that for NESS there is no minimal entropy production rate 
associated with a given set of currents, as is evident from Eq.(16): for any 
the entropy production rates of the NESS can be made arbitrarily small by 
taking S to be large enough [19] . The mapping presented here shows this is also 
the case for stochastic pumps: finite currents can be pumped with arbitrarily 
small values of dissipation, which is somewhat surprising. Stated more generally, 
for any connected graph, both a NESS and a SP can be constructed to have 
any desired set of (time-averaged) probabilities, non-zero currents and positive 
entropy production rates, provided the currents obey Kirchhoff’s law. 

Let us now consider the construction of a stochastic pump with small entropy 
production rates but large currents. For the entropy production rates of the 
NESS to be very small with non-vanishing currents, log (TZijPj^/TZjipf^) must 
be very small, say of order e. Eq.(25) then implies that log (7r“g“/7r“(7“) ~ 0(s) 
as well. Exponentiating this gives (7r“g“/7r“g“) = 1-1- 0(s) thus (7r“)“^(7“ — 
(7r“)“^g“ ^ 0{e). By Eq.(39l this implies S ^ 0{£~^). Therefore, in stochas¬ 
tic pumps - as in NESS - small entropy production rates with non-vanishing 
currents come at the cost of large values in the symmetric part of the rate ma¬ 
trix. But when the elements of S are large, the corresponding transitions occur 
very rapidly. Thus, we obtain finite currents at arbitrarily low dissipation when 
there is a large separation of timescales, with transitions among the n states 
of the system - and therefore relaxation to equilibrium - occurring much more 
rapidly than the external driving of parameters. The greater the separation 
of timescales, the more the stochastic pump approaches the adiabatic (quasi¬ 
static) limit |2] , in which the system remains in thermal equilibrium at all times 
and there is no entropy production. 
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A Details of the specific example: 

The example we consider is shown in Fig([^. It has 4 states with = 

(0.1,0.2, 0.3,0.4). The spanning tree edges are the dashed-doted lines (red), 

and the fundamental current edges are the solid line (black). The fundamental 

currents were chosen such that they form a loop, and their values are fffl = 3, 

Jl^ = 2 and Jff = 1. Once these currents are chosen, the currents for the 
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spanning tree edges are dictated by Kirchoff’s law - the sum of currents in each 
vertex must be zero. The corresponding currents matrix is 


J 


SS 


/ 0 2 -3 1 \ 

-2011 
3-10-2 
\ -1 -1 2 0 / 


(41) 


To set iS, we choose the entropy production rate to be 1 along all the edges. 


Using Eq.(16) the matrix S is given in this case by 


5 = 


/ -14.248 
4.083 
9.0832 

V 1.082 


4.083 

-6.2469 

1.0820 

1.082 


9.0832 

1.082 

-14.2481 

4.083 


1.082 
1.082 
4.083 
-6.2469 ) 


(42) 


and using Eq.(14) 7?. can be calculated, though we will not need it in what 
follows. 

Let us demonstrate our construction on this NESS. For the first step we 
choose 


5 = 


/ -3 

1 

1 

1 \ 


f)) 

f 

4 

1 

1 

-3 

1 

1 

-3 

1 

1 

7f“ = 

V 1 

1 

1 

-3 ^ 


1 i y 


(43) 


We next note that min^-[log — logT^^ipf®] = 1/3. If we therefore choose 

^ such that |log 7 r“ — loggfl < 1/6, condition Eq.(25) is automatically satis- 
hed. Any vector close enough to will do. As an example we use ^ = 
(0.23,0.24,0.26,0.27). In the second half of the period these correspond to 
TTf-= (4,4,4,4) and ^ = (4.3478,4.1667,3.8462,3.7037). 

The next step requires the signs of the currents generated by 77“ = 5(11“)“^ 
with the probability (f*: 


sign 


{Jis) 


= + 1 , sign 


Jh) 


= + 1 , sign 


(Ji) 


= + 1 . 


(44) 


Note that the direction of the current in the 1 — 4 edge is the same as the desired 
current orientation, but for the other two edges the directions are different from 
the desired currents. 


In the second step, we solve Eq.(32) for a^-. 

This gives: 


ofi 3 = 1.7188, 


(45) 

ai4 = 5.2366, 


(46) 

0:34 = 12.2484 


(47) 

Together with the directions the fundamental currents in the two half cycles are 

given by 



j/a = 5.156, = 7.2366, 

= 24.4969, 

(48) 

j /3 = -11.156, 77/4 = -5.2366, 

Jsl = -28.4969. 

(49) 


Note that the averages are the same as the desired values. 
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In the third step we solve for the spanning tree currents, by solving Eqs.( 34|35 l 


for and ■ They are given by 

JI 2 . = -25.4965, JL = 13.4933, = 9.4902, 


'12 

JI 2 = -21.4965, 


J?, = -11.4933, 


24 

jIj = -7.4902. 


(50) 

(51) 


In the fourth step we calculate 5“ and using Eq.(39). We present here 
only the upper part of them as they are symmetric: 


5 “ = 


5 " 


V 


-725.6 

637.4 

43 

45.2 


-885.2 

168.7 

79.1 



-842.1 

612.4 

-736.7 

-596.1 

474.6 

89 

32.5 


-682.8 

143.4 

64.7 



-1032.6 

800.2 

-897.4 




(52) 


(53) 


In the last step, we first calculate dtV on the two half cycles by proper 
summation of the currents: = (37.89,-2.51,5.85,-41.22) and = 

(-37.89,2.51,-5.85,41.22), which as expected cancel each other. These are 
the slopes of the p(t)’s in the first and second halves of the period. To keep 
0 < p(t) < 1, we need to choose T small enough, say for simplicity T = 0.01. 
Using T we can calculate which are the actual probability distributions 

in the two halves. These linear functions are plotted in Fig.Q. Plugging these 
into Eq.(40) gives W(t). 


B Zero currents in the NESS 


If Jff = 0 for some edges 
However 


then clearly = 0 for the same edges as well. 


since > 0 identically (this follows from Eqs. (10) and (11)), we 
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must have afj (t) = 0 for all t in order for the time-averaged entropy production 
rate of the periodic state to be zero. This can only happen if the currents along 
these edges are zero at all time, = 0. A simple prescription to set these 

currents to zero is to use the following modified rate matrix: 

3 


n,, = (s +-j^^)r 


-1 


(54) 


where V is the matrix with the steady state of TZ on its diagonal, is steady 
state current matrix of TZ (but with different factor in front of it), and 



J'ij = 0 and i ^ j 

Jij ^ 0 


(55) 


with the diagonal elements of S changed to make the sum of columns is zero. 
This modified rate matrix, in which the edges with zero steady state currents 
have been “removed” {TZij = 0 on these edges), has the same steady state as 
TZ, but its steady state currents are 1.5 larger then those of TZ. From Eq.(16l it 


also follows that af- = 

*‘J ‘'J 
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Note that forcing some of the TZij to be zero might make the time-dependent 
system non-ergodic, since it might disconnect some of the states from the others 
at all times. This, however, can be overcome by dividing the time interval into 
three equal intervals rather then two. In the first two parts we repeat the 
construction as before, but using it instead of TZ. In the last interval, we choose 
W{t) = 5^(11'^)“^, with Sfj = 1 for any i ^ j and 11'^ the diagonal matrix with 
pps(l = Q) on its diagonal. With this construction, there are no currents in the 
periodic solution during the last time interval, the average currents and entropy 
production rates are the required ones, and the last interval ensures that the 
system is ergodic. 
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